Skip to content

docs: Document MongoDB Change Streams config and resumability#1740

Merged
lukekim merged 1 commit into
trunkfrom
docs/mongodb-change-streams-config
May 18, 2026
Merged

docs: Document MongoDB Change Streams config and resumability#1740
lukekim merged 1 commit into
trunkfrom
docs/mongodb-change-streams-config

Conversation

@claudespice
Copy link
Copy Markdown
Collaborator

Summary

Expand the MongoDB connector docs to fully cover Change Stream support.

Source PRs

Changes

  • website/docs/components/data-connectors/mongodb.md
    • Add five new dataset params to the params table: change_stream_batch_max_size, change_stream_batch_max_duration, change_stream_max_await_time, change_stream_batch_size, mongodb_resume_token_invalid_behavior.
    • Rewrite the "Using MongoDB Change Streams" section with: how it works, prerequisites (replica set/sharded cluster, changeStream privileges, primary_key: _id, on_conflict: { _id: upsert }, supported accelerators), minimal configuration, Change Stream parameter reference table, event mapping for insert/update/replace/delete/drop/rename/invalidate, and resume-token behavior across restarts (file vs in-memory accelerators, sidecar table spice_sys_mongodb, at-least-once semantics).
    • Fix the example Spicepod, which previously used non-existent host: and db: short params instead of mongodb_host and mongodb_db, and omitted the required primary_key/on_conflict for Change Stream operation.

Test plan

  • cd website && npm run build passes locally (Docusaurus throws on broken links and undefined frontmatter tags)
  • Verified parameter names, defaults, and the mongodb_resume_token_invalid_behavior enum values against the source diff
  • Verified _id primary-key/upsert requirement against runtime validation in the source PR

Expand the MongoDB connector docs to cover the Change Stream feature
shipped in spiceai/spiceai#10813:

- Document new dataset params: change_stream_batch_max_size,
  change_stream_batch_max_duration, change_stream_max_await_time,
  change_stream_batch_size, mongodb_resume_token_invalid_behavior.
- Document prerequisites: primary_key=_id and on_conflict={_id: upsert}
  are required for delete/update routing.
- Document resume token behavior (spice_sys_mongodb sidecar, at-least-once
  semantics, file vs in-memory restart behavior).
- Document event mapping (insert, update, replace, delete, drop/rename/
  invalidate truncate path).
- Fix the example to use correct mongodb_* param names instead of the
  invalid `host:` / `db:` short forms.
@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 18, 2026

✅ Pull with Spice Passed

Passing checks:

  • ✅ Title meets minimum length requirement (10 characters)
  • ✅ Has at least one of the required labels: area/blog, area/docs, area/cookbook, dependencies
  • ✅ No banned labels detected
  • ✅ Has at least one assignee: claudespice

@github-actions
Copy link
Copy Markdown

🔍 Pull with Spice Failed

Passing checks:

  • ✅ Title meets minimum length requirement (10 characters)
  • ✅ Has at least one of the required labels: area/blog, area/docs, area/cookbook, dependencies
  • ✅ No banned labels detected

Failed checks:

  • ❌ At least one assignee is required for this pull request.

Please address these issues and update your pull request.

1 similar comment
@github-actions
Copy link
Copy Markdown

🔍 Pull with Spice Failed

Passing checks:

  • ✅ Title meets minimum length requirement (10 characters)
  • ✅ Has at least one of the required labels: area/blog, area/docs, area/cookbook, dependencies
  • ✅ No banned labels detected

Failed checks:

  • ❌ At least one assignee is required for this pull request.

Please address these issues and update your pull request.

@github-actions
Copy link
Copy Markdown

🚀 deployed to https://b78be85e.spiceai-org-website.pages.dev

@lukekim lukekim merged commit f5762a4 into trunk May 18, 2026
6 of 11 checks passed
@lukekim lukekim deleted the docs/mongodb-change-streams-config branch May 18, 2026 22:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants